
O 



10/524180, 




INVESTOR IN PEOPLE 




RBC'D 0 1 SIP ^03 



The Patent Office 
Concept House 



Cardiff Road 
Newport 



South Wales 
NPIO 8QQ 



I, the undersigned, being an officer duly authorised in accordance with Section 74(1) and (4) 
of the Deregulation & Contracting Out Act 1994, to sign and issue certificates on behalf of the 
Comptroller-General, hereby certify that annexed hereto is a true copy of the documents as 
originally filed in connection witli the patent application identified therein. 



In accordance with the Patents (Companies Re-registration) Rules 1982, if a company named 
in this certificate and any accompanymg documents has re-registered under the Companies Act 
1980 with the same name as diat witli which it was registered immediately before re- 
registration save for the substitution as, or inclusion as, the last part of the name of the words 
"public limited company" or their equivalents in Welsh, references to the name of the company 
in this certificate and any accompanying documents shall be treated as references to the name 
with which it is so re-registered. 



In accordance with the rules*, the words "public limited company" may be replaced by p.l.c, 
pic, PX.C. or PLC. 



Re-registration under the Companies Act does not constitute a new legal entity but merely 
subjects tlie company to certain additional company law rules. 




An Executive Agency of the Department of Ttade and Industrv 



BEST AVAIUBLE COPY 




Dated 22 May 2003 



atents Form 1/77 



?atents Act 1977 



leqnest for grant of a patent 

S:ee notes on the back of this form. You can 
Iso get an explanatory leaflet from the Patent 
Office to help you fUL in this form) 



Your reference 



The 

O^^^ATENT OFFICE 

1 5 AUG 2002 
NEWPORT 



mm2 E74U794 D0281 
POl/7700 0.00-0218961 



The Patent Office 

CardifFRoad 
Newport 

GwentNPlOSQO 



PHGB020131 



Patent application "number 

(The Patent Office will fill in this part) 



Full name, address and postcode of the or of 
each applicant {underline all stoTuunes) 



Patents ADP Number (if you know it) 

If the applicant is a corporate body, give the 
country/state of its incorporation 



Title of die invention 



0218961.1 



its AUG m? 



KONINKUJKE PHUiPS ELECTRONICS N.V. 
GROENEWOUDSEWEG 1 
5621 BA EINDHOVEN 
THE NETHERLANDS 



THE NETHERLANDS 



TRANSMISSION METHOD AND SYSTEM 



Name of your agent (if you have one) 
"Address for service" in the United Kingdom 
to which all correspondence shoxild be sent 
(including the postcode) 

Patents ADP number (if you know it) 



If you are declaring priority from one or more 
earlier patent applications, give the country 
and flie date of filing of the or of each of these 
earlier applications and (if you know it) the or 
each apphcation number 



Richard C TURNER 

Philips Intellectual Property and Standards 

Cross Oak Lane 

Redhill 

Surrey RHl 5HA 



Country 



Priority Application number 
{if you know it) 



Date of filing 
{dayAnon^i^ear) 



this application is divided or otherwise Number of e^Her apphcation Date of fihne 

lenved from an earher UK application, give ZT y T? v 

he number and the filing date of the e^Ker (day/month^ear) 
ipphcation 



s a statement of inventorship and of right to 

p:ant of a patent required in support of fliis YES 
equest? (Answer "Yes" if 

') any applicant named in part 3 is not an inventor, or 
) tJia-e is an inventor who is not named as an 
applicant, or 

) tmy named applicant is a corporate body 
eenotefd)) 

Patents form 1/77 



?atents Form 1/77 



Enter the nmnber of sheets for any of the following 

iteins you are filing with tius fomrt 

Do not count copies of the samej^doc\ment 

Continuation sheets of this form 
Description 
Claims(s) 
Abstract 
Drawings 



21 



4 



:0, If you are also jSling any of the following, 
state how many against each item: 

Priority Documents 

Translations of priority documents 

Statement of inventorship and right 

to grant of a patent {Patents Form 7/77) 

Request for preliminary examiiiation and 

search (Patents Form 9/77) 

Request for siibstandve examination 

{Patents Form 10/77) 

Any otiier documents 

{Please specify) 



11. 



I/We request the grant of a patent on the basis of this application. 



12. Name and daytime telephone number of 
ptsson to contact in the United Kingdom 



01293 815492 



(R. Turner) 



After J application for a patent has been filed, the Comptroller of the Patent Office will consider wlrelher publication or 
LmuniZon of the invention should be prohibited or restricted under Section 22 of the Patents ^<^^}^'';^^-J^^'>^ 
informed if it is necessary to prohibit or restrict your invention in this way. Furthermore, if you hvem the VhaedKmgdom 
dction23ofthePatentsActl977stopsyoufromapplyingforapatentabroadwithout^^^^^^ 

Patent Office unless an application has been filed at least 6 weeks beforehand in the United Kingdom for a patent for the same 
invention and either no direction prohibiting publication or communication has been given, or any such direction has been 
revoked. 



Notes 
a) 



If you need help to fill in this form or you have any questions, please contact the Patent Office on 0645 500505. 

b) Write your answers in capital letters using black ink or you may type them. 

c) If there is not enough space for all the relevant details on any part of this form, please continue on a separate sheet oj 
paperandwrite"seeconttmmtionsheef'intherelevantpart(s). Any continuation sheet should be attached to thus form. 

4) Ifyouhave answered "Yes" Patents Form 7/77 will need to be filed. 

e) Once you have filled in the formyou must remember to sign and date it. 

f) For details of the fee and ways to pay please contact the Patent Office. 

Patents Form 1/7'. 



DESCRIPTION 



1 



PHGB020131t 



TRANSMISSION METHOD AND SYSTEM 

The present inve^itlon relates to a method for the streaming of data, to a 
system for the streaming of data, and to apparatus for the streaming of data. 

US Patent 5.768.533 relates to encoding of video In segments which 
are transmitted Independently. If an en-or occurs, the server re-encodes the 
band segment in an l-frame and transmits It again. 

» 

US Patent No. 6.025,888 discloses a system Involving processing of 
data at the server to make the MPEG signals as robust as possible, based on 
determining the most important macroblocks and encoding them in an Intra- 
fashion. Accordingly, the system results In a substantial increase in the MPEG 
signal size. 

US Patent Publication 2001/0019589 discloses processing AV data at 
the server to automatically set the amount of en-or resilience for a particular 
unit of video and hence changes the error correction settings of the transmitter. 

An object of the present invention is to provide a method for the 
streaming of data for use with a limited bandwidth communications network. 

The present invention provides a method for streaming of data with a 
limited bandwidth communications network, the method comprising reducing 
the bit rate stream using transrater means; prioritising the data packets for re- 
sending according to content format and/or age; re-sending the data packets 
according to the prioritlsatlon. 



Advantageously, the prioritlsatlon step comprises one or more of the 
following steps:- 
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. Defining the data packets according to" content type, comprising 

audio data packets and video data packets; 
•r Defining three video packet types comprising l-frames. P-frames. 

and B-frames; 

. Defining, for each data packet type, a weighting factor. 

Preferably the weighting factor Is multiplied by the "age" factor of a data 
packet, calculated by subtracting the sequence number of the missing packet 
from the sequence number of the nfiost recent correctly received data packet 
such that 

P = Wx (S-s), where P is the priority, Wx, is the weighting factor of the 
data, packet type, S is the sequence number of the most recent correctly 
received packet and s is the sequence number of the missing data packet. 

In this way. the present invention provides efficient and effective 
processing to reduce the bit rate; also valuable information about the video 
steam may be used to prioritise the order in which data packets are sent. 

Preferably, the weighting factor Wx for the types of data packet are. in 
reducing order of importance, 

(i) audio; 

(ii) l-frames; 
(ill) P-frames; 
(Iv) B-frames. 

Preferably also, the method comprises re-sending the data packets with 
the highest value of P first and thereafter re-sending in sequence according to 
reducing values of P. with the lowest value of P last 
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The method may include incrementing a resend timer when a new 
pacl<et is received. If a missing pacl^et is not received within an interval, as 
measured by this timer, from sending the original request, then a new request 
is sent. The method may further comprise incrementing the resend -timef-after- 
9 period of receiving no packets. 

In this way, a risk of repeatedly requesting the same packet is greatly 
reduced thus reducing the amount of back traffic from the client to the server. 

An alternative way of avoiding this problem is to restrict the sending of 
request packets such that these are only transmitted on a multiple of a timeout 
value, as measured by the resend timer. 

The present Invention Is particularly suited to the methods of 
transmitting audio and video data using MPEG compression. 

The present invention is also particularly suited to restricted bandwidth 
techniques involving wireless transmission, for example 802.11b (also called 
WiFI) networks. 

The present invention is particularly suited to the transmission of 
MPEG2 audio and data over an in-house wireless network, with a Home Media 
Centre to tune to and store a number of TV and audio streams, and to 
distribute to a number of client devices throughout a home. 

. A significant advantage of the present invention over the acknowledged 
prior art is that It enables the use of wireless protocol optimised for MPEG 
audio and video. 

Another advantage of the present invention is that it does not require 
MPEG streams to be parsed separately using extra CPU cycles. 



« 
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Another aspect of the present invention provides a computer program 
product directly loadable into the internal memory of a digital computer, 
comprising software code portions for performing the steps the method of the 
present invention when said product is mn on a computer. 

i 

Another aspect of the present invention provides computer program for 
performing the steps of the method of the present invention when said product 
is run on a computer. 

A further aspect of the present invention provides electronic distribution 
of a computer program product or a computer accord'ing to a method of the 
present invention. 

A further aspect of the present invention provides a system for 
streaming of data with a limited bandwidth communications network, the 
system comprising: 

transrater means; 

means to input data packets to the transrater means to reduce the bit 
rate stream; 

means to prioritise missing data packets for re-sending according to 

content format and/or age; 

means to re-send the missing data packets according to the 

prioritisation. 

The system may include the additional features of the present invention 
as defined herein. 

A further aspect of the present invention provides a system for 
streaming of data with a limited bandwidth communications network, the 
system comprising: 

transrater means; 

means to input data packets to the transrater means to reduce the bit 
rate stream; 
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means to prioritise missing data packets for re-sending according to 
content format and/or age; 

means to re-send the missing data packets according to the 
• prioritisatiofl: — - . 

5 

A further aspect of the present invention provides server means and/or 
client means incorporating features of the apparatus enibodying the present 
invention- ' 

10 In order that the invention may more readily be understood, a 

description is now given, by way of example only, reference being made to the 
accompanying drawings, in which:- 

Figure 1 is a general diagram of a systern embodying the present 
15 invention; 

Figure 2 is a more detailed block diagram of the system of Figure 1 ; 

Figure 3 shows a server of the system of Figure 1 ; 

Figure 4 shows a client of the system of Figure 1 ; 

Figure 5 is a server state machine diagram of the system of Figure 1; 

20 and 

Figure 6 is a client state machine diagram of the system of Figure 1. 

The system 1 as shown in Figure 1 involves, audio and video streaming* 
25 using MPEG2 compression standard, but it is applicable to other compression 
standards (e.g. MPEG4). Data is taken from a real time broadcast source, or 
off an optical or hard disk. It has a communications network with a limited 
bandwidth, in this example being is the 802.11b wireless network. It has a 
client device with the required AV decoders. 

30 
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The system 1 has a transrater module which it inputs MPEG2 compliant 
video elementary stream, or packetised elementary stream. It outputs a 
MPEG2 compliant video elementary stream. The (average) titrate of the 
• output is capped at a certain lave!, -the- target- bitrate (TBR).The taFget-bitrate- 
5 can be dynamically altered. The frame sjmcture of the stream Is not changed. 
The current transrater works below the slice level, reducing the quantity of data 
(e.g. reducing the number of non-zero DCT coefficients). As it parses the 
bitstfeam, it stores information detailing the structure of the stream. 



10 Description of Current System 

The current implementation of the system mns on a Philips Nexperia - 
PNX8525 IC. This Is a chip designed for adaptable, high end set-top boxes 
and similar systems. It Is a dual CPU machine, it has a MIPS processor for 
overall system control and a TriMedia processor for media processing. 
15 However, the system can be easily adapted for a single CPU machine. 

In the server of Figure 2, the demultiplexer 2 takes in an MPEG2 
transport stream from a tuner. This transport stream can conform to the DVB 

20 standard. The demultiplexer 2 is controlled, via an RPC mechanism, by a 
process running on the MIPS processor. The demultiplexer 2 uses the regular 
input of the transport stream to keep a clock running at 90kHz and also 
outputs an audio and video stream. These streams are packetised In packets 
as defined by the TriMedia Software Streaming Architecture. The data Is 

25 segmented, each segment creating a packet. Each packet is accompanied by 
some data, this data includes the packet length, timestamps, data type etc. 

The transrater 3 takes a video stream, packetised in TSSA packets. It 
works on these packets such that the bitrate of the data contained in the 
30 output packets Is limited to a set value. The output packets are also in TSSA 
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packets. However, the output packets have additional data. This data is added 
by the transrater 3. This data includes the type of frame that the data held 
within the packet belongs to and the length of this frame. 

The ToMips block 4 takes In one audio and oije video TSSA stream. 
The data is extracted from these packets and formatted into the packet 
structure required^ for the wireless protocol. These packets have a header 
which describes the Infomnation held within the packet, this information being 
taken from the TSSA packets. A reading is also taken from the system clock to 
be inserted in each packet header. ToMIPS 4 writes this data into a memory 
region accessible to both processors. The ToMIPS 4 component works with 
the FromiVIIPS component 5 via RPC calls, in order to transfer the data. 

- The FromMIPS block 5 receives the data out of the shared memory 
region and passes it on to the protocol sender. 

The wireless protocol sender 6 handles sending the data across the 
network connection, in this system being an 802. 11b network. 

The system 1 of the present invention incorporates software to transmit 
MPEG2 audio and video data over an in-home wireless network. This network 
incorporates a 'Home Media Centre' which has the capability to tune to and 
store TV streams. This system connects to a number of client devices around 
the home via a wireless network. 

Using this network, the audio and video data is streamed to these 

clients. 

This system has a server combined with a wireless in-home network, for 
example using a Philips Nexperia server (typically a PNX8525 server) with the 
capability to Input three AV streams. One of these Is displayed on the local 
server and the other two are transmitted to two Viper based client systems. 
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The system runs Linux on the MIPS processor in Viper and pSOS on 
the TriMedia. 



Server Architect'ure 

Figure 3 shows a very simplified view of the server architecture having 
three transport stream inputs Si. 82. S3 that demultiplex one or more incoming 
streams. Si Is shown on a local TV display. The video information of the other 
two 82. 83 is processed in MPEG2 transraters To and T, these units act on the 
IVIPEG2 stream such that it does not exceed a certain average bitrate. In order 
to limit the usage of the wireless stream by the video infomiation. 

■ The two transrated To and T^ streams are reunited with their audio as • 
the data is streamed into the wireless protocol WP unit. This unit re- 
multiplexes data and transmits it using the Linux network libraries. It 
communicates with the client in order to achieve the most optimal data 
transmission. 

Client Architecture 

The client Is a much simpler system, for example implemented on a 
Philips PNX8525 system. Alternatively however, it could also to ported be a 
basic TriMedia or a simpler Nexperia device. 

The client runs the Altantic wireless protocol receiver. This acts to 
receive data from the server forwarding the information to the relevant 
decoders. The protocol aims to preserve the quality of the audio and video 
transmitted. 

The system of the present invention utilises 802.11b standard 
communications technology and operates at up to 11 mbps bandwidth, 
although under reasonable conditions the maximum achievable bandwidth .s 
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about 6.5 mbps with transmitted packet size increased from the standard 1500 
bytes. The range with maximum bitrate of the typical 802.11b standard 
networl< embodying the present invention is of the order of 23 meters from the 
server. The communications network uses acknowledgement packets to 
5 ensure good data transfer, [jackets are transmitted by the sender and are 
accompanied by a checksum. This checksum is checked on the receiver; if it 
Is correct, then an acknowledgement Is sent back. If It is not correct, the 
packet is dropped. The emphasis Is therefore on the sender to resend any 
packets. Most Implementations will try and resend a packet limited number of 
10 times. 

In the system of the present invention, the protocol Is implemented in 
two parts. This is due to the dual CPU nature of the units. In the server, both- 
the transport stream input and transrater are resident on the processor. 
15 Therefore, In order to stream the output of these across the network. It is 
necessary to forward the infomfiatlon to the MIPS system running Linux. 
Similarly, on the client, it is necessary to receive the data on the Ml PS/Linux 
processor and fon/vard It to the TrIMedia decoder chain. 

Server 

20 On the server side, a module called 'ToMips' is implemented. This has 

two inputs; one receives video data out of the transrater, the other audio data. 
The ToMips component collates this data into packets of the size used across 
the network. It also fills in the packet header Information. Including a sample of 
the decoder clock on the server. 

25 

The data Is transferred to a process, called 'CopyPacketsTMtoMIPS*. 
which runs on the MIPS. The standard TMMAN RPC calls are used to achieve 
this transfer. This process. In turn, fonvards the infomnation it has gained to a 
Unix pipe. The actual protocol handling process reads this information out of 
30 this pipe. 
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Client 

The client protocol handler feeds the packets it receives into a Unix 
pipe. This is emptied by a 'CopyPacketslVllPStoTM' which uses TIVIMAN calls 
to fonward packets to the 'FromTIVI' task on the TriMedia. This task 
demultiplexes the data and fonwards the data to the audio and video decoders. 

The software protocol provides a resilient connection, optimised for the 
transmission of audio and video data, between two systems. 

The protocol is built on top of UDP. ^ 

The system uses the Linux IP network stack with changes to three settings, 
namely: 

• Send Buffer Size: The size of the transmission buffer for a socket; 

• Receive Buffer Size: The size of the receive buffer for a socket. 

« Type of Service (TOS): These are special bits, defined by the IP standard 
which fit in the IP header. They define the type, or 'importance* of the 
packets sent by the socket. Linux uses the setting in these packets to 
prioritise the order in which it sends packets. The allowable settings for this 
field are: 

• Low Delay: Send as soon as possible 

• Throughput: Attempt to maximise throughput 

• Reliability 

. Minimum Cost: Lowest level of priority. 



The server transmits the data, encapsulated in packets, to the client by 
sending it. in order, through a UDP socket targeted at an open UDP socket on 
the client. This connection is initialised and mediated by an open, connected 
TCP link between the two systems. This is the 'Command Link". One of the 
commands that is allowed on this link is a 'Resend' command. This interrupts 
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the server from sending new data over the link. Instead it transmits the pacl^ets 
requested in the resend command packet. 

- The protocol uses a simple packet structure to encapsulate the data. The 
packet jjieader contains critical information about each packet. This includes: 

• Sequence Number: Each packet is uniquely identified by a 32-bit sequence 
number 

' • Timestamp: Packets can be accompanied by a timestamp which describes 
when the data in the packet should be decoded or presented 

• Clock Reference: Inserted by the server, used by the client to reconstruct 
the system clock ♦ 

• Data Type: Audio, Video (including I, P or B Frame) 

Server 

The server is run at start-up as a daemon process. This server process 
initialises the 'Listening Socket* and waits for clients to connect to it. This is a 
standard TCP socket such that incoming connections can be received and 
then accepted and bound, such that other clients can still connect to the main 
listening socket. Once a client has connected, then a new process, a sender 
process, is forked off from the server process. 

Sender Process 

The newly created sender process then waits for an 'Initialisation' 
command from the client. This includes a lot of important information, including 
the Identifier of the data required and the address/port of the data sockets that 
have been created on the client unit. This information is parsed and stored in a 
local data structure. 

The sender process then creates the UDP sockets for the connection 
(the TCP sockets are inherited from the server process). Two are created as 
they have different TOS settings. The streaming socket is set as 
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TOS_THROUGHPUT - to maximise bandwidth and throughput. The resend 
socket is set as TOS_LOWDEl_AY - to minimise the delay in sending this 
data. 

The sender then initialises a circular packet store. This is used to keep 
a number of packets that have already been sent. At this point, the system 

then enters the main protocol state machine. 

•» 

Sender State Machine 

Whilst there is data to send, the sender process loops around inside a 
state machine. A §implified representation of this machine is shown in Figure 
5. 

As can be seen from Figure 5. data is received from the data source, 
this data is inserted into the circular buffer, and this data is then sent to the 
client. This process is inten^ipted by commands arriving from the client, 
especially if the client is requesting data be resent. In this case this data is 
given priority and is sent to the client using the low-delay socket. 

This representation is simplified in a number of ways, as explained 
20 hereinbelow. 
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Client Process 



The architecture and operation of the client process tend to be simpler 
25 than the server architecture it is only deadline with a single stream and so it 
consists of only one process. 

At start-up. the client creates a socket and attempts to connect to the 
server. Once connected, it then creates the UDP socket on which data will be 
30 received. It then builds and sends a "Initialise" command containing the port 
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number of the UDP socket, which data stream is required, and any other 
options to server. 

Then, the- client state machine (Figure 6) receives the data on the input 
socl^et (see Figure 6). Each pacl<et is inserted into the local circular buffer, the 
position in the buffer is detennined by the sequence number embedded in the 
pacl<et header. The circular buffer is then scanned between the last fonvarded 
packet and the latest input packet creating a list of missing packets. This list is 
then used to build a Resend command, which is sent to the server process, via 
the command sockets. 

If the next packet in the sequence is available, this is forwarded to the 
■ output data pipe. • 

Commands 

Commands are special packets that can go from server to client, or 
client to server. Commands are usually sent on the connected TCP/IP link, 
although the software is also designed to allow command communication to go 
across the UDP data link. 

Command Packet Structure 

The command packet is adaptable, such that it can be used by the different 
commands, whilst minimising the amount of data transmitted. The basic 
header consists oft 

• Command ID; 

• Generic 32-bit value; 

• IP address of command's source; 

• IP port of command's source; 

• Length of extended data; 

• Extended data. 
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The command structure has very few static variables - the majority of 
information is in command-specific data appended to the end of the structure. 

Resend Command _ 

One of the most frequent commands ,used whilst streaming is the 
5 'Resend' command. This is sent by the client to ask the server to resend a 
number of packets which have not been received. The server will then make 
sending these packets Its highest priority. 

The resend command extends the default command structure by 
fo appending a variable length structure on the end. This structure contains a 
run-length encoded listing of the packets that are missing. Therefore the 
extended data included, additional to the standard command infomnation, is: 

• Length of bad packet array; 

• Maximum length of buffer; 

15 • An-ay of bad packets (start packet and run). 

Past Packets Command 

The past packets command is sent from the server to the client. It is 
used when the client requests that a packet be resent, however this packet 
has already been dropped from the server's circular buffer and therefore 
cannot be resent. It is not frequently used, but is important after a bad drop-out 
of the radio link. 



20 



The past packets command lists the packets that have been requested 
that cannot be resent. 

25 initialise/Start Command 

At start-up, a number of important variables and options are sent from 
the client to the server. This is done via a start command. 
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The start command includes: 

• IP address of client device; 

• A number of settings of binary options; 

Lengtfi of data-packetsr — 

• Filename of required data: this can either be a file on^isk, or a 'special 
file' that represents a real-time data source. 

Packet Prioritisation * 

When a resend command Is sent from the client to the server, the 
server builds and maintains a list of the packets that need to be resent. 
Additional information about the contents of these packets is used to prioritise 
them. For example, audio packets are given a higher priority than video, so 
that there are no glitches in the transmitted audio. Similarty, the transcoder 
provides information about the video stream. This information is used to 
prioritise the data such that packets containing data from an I frame have 
priority over P frames, which, in turn, have priority over B frames. 

The priority of a packet Is calculated by a simple formula. Four different 
types of packet are defined: one for audio and three for video (these contain I, 
P or B frames). Each packet type has a weight defined for it (Wa, Wi, Wp, Wb 
respectively). These weights are multiplied by the 'age' of a packet, this is 
calculated by subtracting the sequence number of the missing packet from the 
sequence number of the most recent packet that has been received correctly 
(which will be greater than any missing packet). 

P = Wx(S-s). 

where P is the priority, W the weight of the specific packet type, S the 
sequence number of the most recently received packet and s the sequence 
number of the missing packet. 



16 



PHGB020131 * 



Thus this priority factor is used such that the higher the value of P. the 
higher the priority given to the pacl<et. 

• -• - Once the-prioFity -Gf-aii missing packets has been caiculatedi this-4s- - 
sorted into a table of misfing packets in the order they are to be sent. 

Delayed Resend Commands 

Thus client creates a list of missed packets each time a new packet is 
received. To avoid the risk of a large amount of back traffic from the client to . 
the sen/er. requesting the same packet(s) (due to the latency of the round-trip 
of the resend command) the system operates in one of the following two ^ays: 

1. Each new packet received increments a 'resend timet^. A packet is only 
requested on certain intervals of this timer (the period of this is called 
the resend timeout period). For example, in a system with a resend 
timeout of 16 packets, it might be determined that packet X is missing 
after receiving packet Y. Requesting this packet Is repeated when we 
receive packet Y+16. Y+32 etc. until the packet is received con-ectly. 

To avoid a deadlock, the resend timer is also incremented after a period 
of receiving no packets. 

2. The system is set such that resend commands are only sent on a 
certain interval of the resend timer. Hence, resend commands are 
calculated and sent for every N packets that are received. This is called 
the 'delayed Nack* method. 

The first resend operation can lead to a large number of small resend 
commands being sent. The second resend operating may lead to a higher 
average latency in sending resend commands. 



The software defaults to the first resend operation. 
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Heartbeat 

In order to avoid a situation in which the system could not detect if a 

client .was .switched off .or died, but the sen/er would keep transmitting and 

would receive no resend messages back from the client, provision is made for 

t 

5 another packet type to the network, namely a 'heartbeat' that is sent from the 
client to the server at regular intervals. If the server does not note the 
heartbeat for a reasonable length of time, then It assumes the client has died 
and resets the link so that the client can reconnect. 

10 The heartbeat is sent using UDP sockets. Inside the heartbeat packet 
some simple statistics are packaged about the client's view of the link which 
are reported to the server. 

Pull Mode 

It has been assumed that the data being sent over the link is generated 
15. in real-time by the transrater module. In this mode, data is taken out of the 
transrater as fast as possible and transmitted over the link. This is a typical 
'push* mode system - in which the decoder keeps up with all data transmitted. 

In a variant, a user may want to read from a file, transmit this and then 
20 let a decoder work on it. In this mode, the data requirements are dictated by 
the decoder, as this processes the data at its own rate. This is a typical 'pull' 
mode. 

The protocol implements a simple pull-mode system by allowing the client 
25 to send pause and resume messages to the server. This works thus: 
. • The server starts sending packets to the client; 

• The client starts receiving packets and fonA^arding these into the 
decoder; 
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• The client detects that the number of packets waiting is greater than a 
certain value, the high-level watermark. The client sends a pause 
message to the server; 

— • ■ The server stops sending packets; * 

5 ^ • The client continues to forward packets to the decoder; 

• The client detects that the number of packets waiting is less than a 

certain value, the" low-level watermark". The client sends a resume 

i 

message to the server; 

• The server starts sending packets again. 

10 Clock Handling ^ 

In order to keep audio and video synchronised on the client, it is 
necessary to generate a stable clock signal. However, due to the 
indeterminate nature of the wireless network linking the client unit and the 
server unit, it is very hard to lock the client's clock to the server's. 

15 

The higher-level protocol handler, not the base-level protocol, handles 
clock handling or regeneration as it makes it easier to change the clock 
handling code. The protocol does, however, resen/e space in the packet 
header for two items of clock information. These are the timestamp for the 
20 packet and a clock reference on the server at the point the packet is inserted 
into the queue. 

In the system, the clock handling is done in the TSSA source and sink 
components (ToMips' and 'FromMips'). 

25 ToMips 

The ToMips component reads the timestamp out of the TSSA packet 
headers as it receives and repackages the packets. It reduces these 
timestamps to a 32-bit value and places them in the reserved timestamp field 
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in the Atlantic packet header. Also, as it forwards each packet, it reads the 
system clock and inserts this value into the packet header. 

To ensure that old data is not sent over the wireless link, using up 
valuable bs^pdwidth, the TSSA packets are filtered as they arrive in the ToMips 
component This simply compares the timestamp of the packet with the current 
clock value, if the timestamp is past a certain threshold older than the cunrent 
clock, the packet is dropped and not fonA^arded. * 

FromMips 

The FromMips component reconstructs TSSA packets out of packets. 
This includes the timestamp information in the packet header. 

To reconstruct the clock on the client, the client's clock free-runs, being set by 
the first packet arriving and when the difference between the client's clock and 
the clock reference in a packet is greater than one second. This relies on the 
two systems clock running at the same rate, this providing an accuracy within 
. a few parts in a million. 

A variant to the above system may be to implement the protocol at a lower 
level - the closer this gets to the MAC level the less jitter on the receiveing 
clock, thereby driving the clients clock. 



Packet Header 

The packet header consists of: 



Type 


Name 


Description 


u32 


Sequence Number 


A 32-bit sequence number. Used to spot out 
of order and missing packets. This is one 
difference from RTF header, which only has 
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a 16-bit sequence number. 




Packet Timecode 


DTS of the data contained in cun-ent paclcet. 
If zero, tinis is equal to the last non-zero DTS 
value. 


u32 


Time Reference 


Current value of 90kHz clock on server. ^ 


u8 


Data Type 


Type of data. Currently only audio and video 
defined. (Video = 0, Audio = 1) 


i\R 
uo 


Frame Seauence 
Number (Somewhat 
deprecated) 


If the source is parsing the data to discover 
frame types, this also keeps count of frames. 
This can be used to spot new frames, or to 
recreate timestamps on the client, if 
required. 






Current packet length 


u16 


Flags 


A number of flags, describing the data in the 
packet. Some of these are transmitted 
across the link (e.g. frame type), others are 
used Internally in the protocol state 
machines 


u16 


Picture Start 
(Deprecated) 


This used to be used to point to the MPEG 
picture start (i.e. after Sequence, GOP 
headers etc.). 



The length of the current header is 20 bytes. If required this could be reduced 
to 16 bytes. 



5 Command Header 



Type 


Name 


Description 


u32 


Command 


The type of command. Possible values are: 
0. Null (No command, for test only) 
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1. Start (Start streanning) 

2. Pause (stops server from sending 
non-resend packets) 







— 37— Unpatjse-^allows server to- send non— 
resend packets) 

4. Resend request 

5. End stream (tells client to expect the 
. end of stream at a particular 

sequence number) 

6. Restart (deprecated - restart sending 
* ' from a particular sequence number) 

7. Past packets (allows the server to list 
a number of packets that are no 

longer available): 

8. Exit (Immediate exit requested). 


u32 


Value 


A generic 32-bit number, which is command 
dependant 


u32 


Client IP 


IP address of the client device 


u16 


Client Port 


Data port of client device 


u16 


Extended Data Length 


Length of data on the end of this command 
packet 
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CLAIMS 

_ i A method for- streaming- of -data with a limited bandwidth. 

5 communications network, the method comprising: ^ 

reducing the bit rate stream using transrater means; 
prioritising missing data packets for re-sending according to 

content format and/or age; 

re-sending the data packets according to the prioritisation. 

10 

» 2. A method according to Claim 1 wherein the prioritisation step 
includes defining the data packets according to content type, comprising audio 
data packets and video data packets. 

15 . 3. A method according to Claim 1 or 2 wherein the prioritisation 
step includes defining three video packet types comprising l-frames ,P-frames, 
and B-frames. 

4. A method according to any preceding claim wherein the 
20 prioritisation step includes defining, for each data packet type, a weighting 

factor. 

5. A method according to Claim 4, wherein the weighting factor is 
multiplied by the "age" factor of a data packet, calculated by subtracting the 

25 sequence number of the missing packet from the sequence number of the 
most recent correctly received data packet such that 

P=Wx(S-s), 

where P Is the priority, Wx. is the weighting factor of the data 
packet type, S Is the sequence number of the most recent correctly received 
30 packet and s is the sequence number of the missing data packet. 
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6. A method according to Claim 4 or 5 wherein the weighting factor 
W for the types of data pacl<et are, in reducing order of importance: 

(i) audio; 

- (ii) l-framesr ■ - 

(iii) P-frames; 

(iv) B-frames. 

7. A method according to Ciaim 6 comprising re-sending the data 
pacl<ets with the highest value of P first and thereafter re-sending in sequence 
according to reducing values of P. with the lowest value of P being last. 

♦ 

8. A method according to any preceding claim comprising 
incrementing a resend timer when a new data packet Is received,- and 
requesting a data packet at certain intervals of the timer. 

9. A method according to Claim 8 further comprising incrementing 
the resend timer after a period of receiving no data packets. 

10. A method according to any of Claims 1 to 7 comprising 
transmitting resend commands only on a certain interval of the resend timer. 

11. A method according to any preceding claim wherein the limited 
bandwidth communications network comprises a wireless network. 

12. A computer program product directly loadable into the internal 
memory of a digital computer, comprising software code portions for 
performing the steps of any one or more of Claims 1 to 11 when said product 
is run on a computer. 



13. A computer program for perfomnlng the steps of any one or more 
of Claims 1 to 1 1 when said product is run on a computer. 
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14. Electronic distribution of a computer program product according 
to Claim 12 or a computer according to Claim 13. 

.^5 A_s.ystein._fQt_.streamlng-. .Qt_data_.with a. limited bandwidth.... 

5 communications network, the system comprising: 
transrater means; 

means to input data packets to the transrater means to reduce 

the bit rate stream; 

means to prioritise missing data packets for re-sending according 

10 to content format and/or age; 

means to re-send the missing data packets according to »the 

prioritisation. 



16. A system according to Claim 1 5 wherein the prioritisation means 
15 includes means to define the data packets according to content type. 

comprising audio data and video data packets. 

17. A system according to Claim 15 or 16 wherein the prioritisation 
means includes means to define three video types comprising l-frames .P- 

20 frames, and B-frames. 

18. A system according to any of Claims 15 to 17 wherein the 
prioritisation means includes means to define, for each data packet type, a 
weighting factor. 
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19. A system according to Claim 18. wherein the v^^eighting factor Is 
multiplied by the "age" factor of a data packet, calculated by subtracting the 
sequence number of the missing packet from the sequence number of the 
most recent con-ectly received data packet such that 
30 P = Wx(S-s). 



• 
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where P is the priority, Wx, is the weighting factor of the data 
packet type, S is the sequence number of the most recent correctly received 
packet and s is the sequence number of the missing data packet. 

5 20. A system according to Cjaim 18 or 19 wherein the weighting 

factor W for the types of data packet are, in reducing order of importance: 
(i) audio; 
' (ii) {-frames; 

(iii) P-frames; 
10 (iv) B-frames. 

. 21 . A system according to Claim 20 comprising means to re-send the 
data • packets' with the highest value of P first and thereafter in ' sequence * 
according to reducing values of P, with the lowest value of P being last. 

15 . ' . 

22. A system according to any of Claims 15 to 21 comprising means 
to increment a resend timer when a new data packet is received, and 
requesting a data packet at certain intervals of the timer. 

20 23. A system according to Claim 22 further comprising means to 

increment the resend timer after a period of receiving no data packets. 

24. A system according to any of Claims 15 to 23 comprising means 
to transmit resend commands only on a certain interval of the resend timer. 

25 

25. A system according to any of Claims 1 5 to 24 wherein the limited 
bandwidth communications network comprises a wireless network. 

26. Apparatus for streaming of data with a limited bandwidth 
30 communications network, the apparatus comprising: 

transrater means; 
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means to input data packets to the transrater means to reduce 
the bit rate stream; 

means to prioritise missing data packets for re-sending according 

Jo-contentiormat and/or age; . . - — — 

^ means to re-send the missing data packets according to the 

prioritisation. 

27. Apparatus according to Claim 26 wherein the prioritisation means 
includes one or more of the following: 

means to define the data packets according to content type, 
comprising audio data and video data packets; ♦ 

means to define three video types comprising l-frames ,P- 
frames, and B-frames; - 

means includes means to define, for each data packet type, a 
weighting factor. 

28. Apparatus according to Claim 27, wherein the weighting factor is 
multiplied by the "age" factor of a data packet, calculated by subtracting the 
sequence number of the missing packet from the sequence number of the 
most recent correctly received data packet such that 

P = Wx(S-s), 

where P is the priority, Wx, is the weighting factor of the data 
packet type, S is the sequence number of the most recent correctly received 
packet and s is the sequence number of the missing data packet 

29. Apparatus according to Claim 27 or 28 wherein the weighting 
factor W for the types of data packet are, in reducing order of importance: 

(i) audio; 

(ii) l-frames; 

(iii) P-frames; 

(iv) B-frames. 
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30. Apparatus according to Claim 29 comprising means to re-send 
the data packets with the highest value of P first and thereafter in sequence 
according to reducing values of P, with the lowest value of P being last. 
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ABSTRACT 

TRANSMISSION METHOD AND SYSTEM 

- There is provided transmission of MPEG2 audio and data over an 4n 

5 house wireless network using the 802.1 1b standard with a Home Media Centre ^ 
to tune and store a number oiF TV and audio streams for distribution to a 
number of client devices throughout a home. 

A transrater reduces the bit rate for use in the limited bandwidth 
10 wireless communications networI<. Prioritisation of the data packets for 
resending Is made according to content format and/or age. 
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